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^ Abstract 

The applications of nonequilbrium relations such as the Jarzynski equality and the fluctuation theorem to spin glasses are consid- 
ered. The spin glass is a basic platform where we consider an application of an approximate solver of combinatorial optimization 
J>~»problems, simulated annealing. We find a novel relationship between an average through a nonequilibrium process where the tem- 



(N 



perature changes as in simulated annealing and a thermal average in equilibrium with different amounts of quenched randomness. 
The results shown in the present study may serve as an alternative way to overcome critical slowing down in spin glasses. It means 
Ihat this way may mitigate difficulties in several hard optimization problems. 
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1. Introduction 

To reduce power loss in electric circuits, we have to minimize 
the ckcuit length. This kind of problems are formulated into a 
more generic task to minimize or maximize a real single-valued 
function of multivariables. This is the optimization problem. 
The cases in which variables take discrete values are known as 
combinatorial optimization problems To solve these prob- 
lems is one of the most important tasks and has broad applica- 
tions in science and engineering. 

One of the generic algorithms to tackle such problems is 
simulated annealing (SA), which has been developed to obtain 
the ground state of complex system such as the spin glasses, 
namely the minimization of the energy by stochastic searching 
in complicated phase space f?]. The system is driven by de- 
creasing the temperature, which controls thermal fluctuations, 
according to a certain schedule. If the decrease speed is slow 
enough, the system stays at quasiequilibrium at each tempera- 
ture. We hope that the system reaches its ground state in the 
end. However the existence of many local minima of the free 
energy of spin glasses leads to a plenitude of time scales which 
make it difficult to reach the equilibrium state, the global min- 
imum, experimentally or in numerical simulations. It is thus 
sometimes difficult to find a correct solution in the protocol of 
SA due to the long equilibration time on spin glasses. Most 
of the optimization problems are expected to have similar diffi- 
culties since they can be mapped into searching problem of the 
ground state of spin glasses. 

The above fact implies that the system during the process 
of SA applied to difficult problems is not close to their equi- 
hbrium. We therefore search for useful tools in nonequilib- 
rium statistical physics to mitigate the difficulties. During the 
last decade, a number of exact relations have been derived for 
nonequilibrium processes. The Jarzynski equality is one of 
these remarkable results. It shows that a statistical quantity de- 
pending on the work W performed on a system in contact with 



a heat reservoir at an inverse temperature fi during a nonequi- 
librium process, exp (-ySW), is related to the free energy differ- 
ence AF between two equilibrium states, which are determined 
by the initial and final Hamiltonians of the system JHQl- This 
nonequilibrium relation holds for any intermediate schedule to 
change the parameter contained in the Hamiltonian. As one 
of the algorithms in numerical simulations, a practical use of 
the nonequilibrium relations has been proposed by several re- 
searchers In the present work, we consider analytical 
applications of several nonequilibrium relations to spin glasses 
and establish the fundamental theories in order to overcome dif- 
ficulties attributed to the critical slowing down in those systems. 

We especially apply the nonequilibrium relations to spin 
glasses with the gauge symmetry for which we can exactly cal- 
culate several quantities As a result, we can obtain sev- 
eral exact relations between the nonequilibrium processes for 
spin glasses starting in a special subspace and the system prop- 
erties in equilibrium characterized by diff'erent parameters from 
the properties at the starting point. 

The present paper consists of five sections. In Section 2, 
the gauge symmetry of the spin-glass model is reviewed. In 
the next section, we introduce the nonequilibrium relations, the 
Jarzynski equalityand a more generic theory, the Crooks fluc- 
tuation theorem | iH ■ After then, we evaluate the nonequi- 
librium relations on the Nishimori line in Section 4. In the last 
section, we give a summary of the obtained results. 

2. Spin glasses 

2.1. Model 

Let us consider the following simple spin-glass model, 
known as the random-bond Ising model, whose Hamiltonian 
is 

H^-Y,JijSi{t)Sj{t), (1) 

(U) 
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where is the Ising spin taking values ±1. The summation 
is taken over all bonds. One may suppose usual nearest neigh- 
boring bonds on a c/-dimensional hypercubic lattice. We make 
no restrictions on the type or the dimension of the lattice in the 
present paper We can consider several types of bond distri- 
butions for the quenched randomness 7,j such as the Gaussian 
distribution. We restrict ourselves to the case of Jij taking +J 
for simplicity. The following analyses are straightforwardly ap- 
plied to other cases. 

We separate the sign from the interaction as r/^, which 
takes + 1 , below. We combine the strength J of the interactions 
with the inverse temperature /3 as K = fiJ. The distribution 
functions for r,j can be written as |8, 9] 



2 cosh Kr, ' 



(2) 



where exp{-2Kp) = (1 - p)/p- In the analysis of spin glasses, 
we need to evaluate not only the thermal average as (■ • ■ but 
also the configurational average [■ ■ ■]kp for tij as 



, , 2 cosh /To 

iij> 



(3) 



2.2. Gauge transformation for spin glasses 

Here we introduce the gauge transformation in spin glasses 
M,^- The gauge transformations for functions depending on 
S,(0 and T are defined as 

Si(t) ^ Si(t)(Ti (4) 

Tij TijO-iO-j. (5) 

For instance, the instantaneous Hamiltonian ([T]i is invariant un- 
der the gauge transformation, while the bond distribution func- 
tion (|2]i is changed to 



2 cosh Kn 



(6) 



Another important property is the invariance of summation over 
{Siit)] and {Tij}, since the gauge transformation merely changes 
the order of the summation. 

Here we briefly give the general scheme of the analysis in 
random-bond Ising systems by the gauge transformation. If we 
take the configurational average of the gauge-invariant quantity 
g({Tij}), we find that 



<'7> 



(2cosh/:„)'Vi'' 



(7) 



where Nb expresses the number of bonds. Since the left-hand 
side of this equation is independent of cr, the right-hand side is 
unchanged if we consider other configurations of cr. Therefore 
the summation over all possible configurations cr yields the fol- 
lowing relation with the coeflicient consisting of the partition 
function with the coupling Kj, 



(T,) 2^ (2 cosh /Tp) 



(8) 



where denotes the number of sites. The partition function for 
the random bond Ising model is given as 



Z(/:;{T,;)) = ^f[e^---'-^ 

'^i (ij) 



(9) 



Using the above properties of the gauge transformation, for in- 
stance, we can obtain the exact value of the internal energy on 
a special subspace K - Kp, known as the Nishimori line (NL), 
as Hi 

[(^/>djf = -A^B/tanh/i:. (10) 

As seen in this equation, the internal energy does not show any 
singularlities along NL. We can evaluate an upper bound for the 
specific heat and some set of equalities and inequalities for the 
correlation functions on NL in similar ways. 

3. Nonequilibrium relations 

Let us consider the case that the system evolves follow- 
ing stochastic dynamics governed by the master equation. We 
change the value of the coupling K from Kq ait - to to Kf at 
t = tf. Correspondingly, the spin configuration {S i(t)} changes. 

3.1. Jarzynski equality 

The original version of the Jarzynski equality relates a quan- 
tity depending on the performed work during a nonequilibrium 
isothermal process and the free-energy difference between equi- 
librium states for the initial and final Hamiltonians |3, 4]. In 
the original formulation of JE, the work is defined as the energy 
difference due solely to the change of the Hamiltonian, and the 
heat is described by the energy difference through the change of 
the degrees of freedom in the system. We can simply establish 
a variant version of JE in the case of changing the inverse tem- 
perature, which is useful in the following application, by defin- 
ing flie work as -/3W({S i(m = -(K(tk^i) - KmE({S i(tk)}), 
where £({5,(0)) is the instantaneous energy for the spin config- 
urations {S ,(f)) given by the Hamiltonian ([T]) divided by J. Then 
the Jarzynski equality can be written, similarly to the original 
version of JE, as 



(e-P"^) 



ZjKf, {Tij}) 
Z(Ko;{Tij}y 



(11) 



The brackets (• ■ • }a^b denote the average over various spin 
configurations realized in the nonequilibrium process starting 
from equilibrium at f = to. We write the probability for the 
realized spin configurations from the initial spin configuration 
in equilibrium as PKo^Kf{{S i{t)}) by use of the solution of the 
master equation. The average can then be expressed as 



<O(IS,(0l))i,^,-, 



(12) 



{s,(f)i 



where 0{{S ,(f)}) denotes an observable as a function of each re- 
alization of the spin configuration in a nonequilibrium process, 
and the summation extends over instantaneous spin configura- 
tions. 



3.2. Crooks fluctuation theorem 

The Crooks fluctuation theorem, which can be regarded as 
a more general version of the Jarzynski equality |T3 HI, re- 
lates PK„^Kf{[S with the probability Pk/^Kq {{Siim of the 
inverse process as 



PKr^UiSiit)}) 
This relation yields IT2I] 



(13) 



= {OA{Sim)K,^K, 



(14) 



where denotes the observable which depends on the back- 
ward process Kj — > Kq. A simple instance of 0{{S i{t)\) for the 
Ising spin system is the autocorrelation function 5, (fo)^,^?/). If 
we set an observable depending only on the final state, denoted 
by Of, instead of (9({5,(f))), then means an obsevable at the 
initial state in the backward process. Therefore {Ot)Kf^Ko sim- 
ply equals to the ordinary thermal average at the initial equilib- 
rium state with the coupling constant Kf as 



^{0)k 



Z{Kf- It,;}) 



(15) 



These equations (fTTT i. (fT4l i and (fTsT i can be proven under several 
formulations for a nonequilibrium process, the master equation, 
the Langevin equation, and the Fokker-Planck equation. We 
have employed the master-equation approach in Ref. [4J in the 
following analysis, since it is often used in the numerical sim- 
ulation of spin glasses. For the analysis of the master equation 
for Ising spin systems, several rules for the dynamics such as 
Metropolis lfl3ll and Glauber dynamics lfl4ll are available, but 
we can prove that the following results are independent of the 
type of dynamics. 

4. Nonequilibrium relations on the Nishimori Line 

For a fixed bond configuration {T,y), we apply the nonequi- 
librium relation ( fTSl l to gauge-invariant quantities denoted by 
g{{Tij]). After then, we take the configurational average as fol- 
lows. 



Ko—*Kf 



Z(Ko; {Tij]) 



(16) 



The quantity on the left-hand side means the configurational 
and nonequilibrium-process average of the observation of g at 
the final time tf, that is after the protocol Kq — > Kf. On the 
other hand, the quantity on the right-hand side means the con- 
figurational and thermal average of the equilibrium state for the 
final Hamiltonian. We use the gauge transformation to cancel 
the partition function of the denominator on the right-hand side 



in the above relation. The right-hand side of Eq. ( fTSI ) is rewrit- 
ten explicitly as 



{gi{Tij]))Kj 



ZiKf, {Tij]) 



ZiKo; {Tij}) 



pZiK,yAru)) (2 cosh /T^)^" 



(17) 



All the quantities in this equation are invariant for the gauge 
transformation. We thus obtain 



{gi[rij]))K, 



ZiKf, {Tij]) 



Z{Ko- {tu}) 



{g({Tij}))KfZ(Kp; {tij}) Z{Kf- [Tij}) 
2'V(2cosh/:„)'V« Z{K^-[Tu}y 



(18) 



We here introduce the quantity {g{{Tij}))Kf ■ Similarly to the 

L J Kp 

above calculation, we obtain the following identity by the gauge 
transformation to this quantity. 



{g{[rij]))KfZ{Kp; [Tij}) 



2'^(2 cosh/Tp)'^* 



(19) 



Setting Kp - Kq in Eq. ([TUl and Kp - Kf in Eq. ([T9]l, we find 
a nonequilibrium relation for spin glasses by a simple algebra. 



[<5/((T,7))e-^'^)^„^^4^ 

= [(^({T,7}))^,].. 



2 cosher 



■/ \ 2 cosh Kq 



(20) 



If we set g/({T,j}) = 1, we obtain the Jarzynski equality for spin 
glasses. 



2 cosh Kf^'^" 
2 cosh Kq 



(21) 



The relations ( l20l i and ( 1211 1 do not include a nontrivial free- 
energy difference as in ordinary non-equilibrium relations (fTTT i. 
(fT4l i. and ( fTSl l. By Jensen's inequality, we derive the lower 
bound of the nonequilibrium work in terms of fiW on spin 
glasses with the gauge symmetry as 



[y8<Wk„^j,,]^^ > -Analog 



2 cosh/T 



2 cosh K 



(22) 



All of the above results hold for any dimensional systems. For 
spin glasses with the gauge symmetry, the lower bound of the 
nonequilibrium work is trivially given by the initial and final pa- 
rameters. This lower bound means the value for the case of the 
quasistatic process. Even in the thermodynamic limit, in which 
the phase transition occurs, it does not possess any singularity. 
We remark that the process does not go along NL. 
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Figure 1: Two related processes by the nonequilibrium relation i24l . 
Three phases (F: Ferromagnetic, P: paramagnetic, and SG: Spin Glass) 
are separated by a solid curve and a vertical line. The dashed and 
inclined line expresses NL. 



If we substitute ^/({r,j)) = H into Eq. ( l20t as an instance, 
we obtain 



f/z/e-'^"') 

= f<^>^4J2cosh/ro 



2 cosher 



(23) 



This equation shows that the internal energy after the cooling or 
heating process from a temperature on NL is proportional to the 
internal energy in the equilibrium state on NL corresponding to 
the final temperature. 

It is straightforward to obtain the nonequilibrium relation for 
the case of gauge-invariant quantities depending on the instan- 
taneous spin configurations, for instance, the autocorrelation 
function 5, (fo)5,(f/) as. 



2 cosh K 



= [<^,(.o)5,(./)).,..„],^.(^^) . (24) 

This gives quite a mysterious relationship between the cooling 
and heating processes but with different amounts of quenched 
randomness characterized by Kq and Kf. Let us consider the 
cooling process from a temperature on NL given by (ZTo, Kq) to 
a point away from NL (I/Kq, l/Kf) as depicted by the down- 
pointing arrow in Fig. [T] Then the above equation relates 
this process with an inverse process from a temperature on 
NL (l/Kf, l/Kf) to a point away from NL (l/Kf,l/Ko) rep- 
resented by the upward-pointing arrow in Fig. [T] The upward- 
pointing arrow process passes through the ferromagnetic and 
paramagnetic phases, whereas the cooling process goes through 
the spin glass phase with long-time equilibration. Its physical 
meaning should be studied in the future. This result may be- 
come an example to overcome the problem concerning long- 
time equilibration on spin glasses by the nonequilibrium rela- 
tions. 



5. Summary 

We considered the application of the nonequilibrium rela- 
tions to spin glasses with the gauge symmetry. The gauge sym- 
metry enables us to change the non-trivial factor, the free energy 
difiference, appearing in the nonequilibrium relations into a non- 
trivial factor given by the normalization factor of the quenched 
randomness. 

This study can be regarded as a practical application of the 
nonequilibrium relations to SA for spin glasses. As one of 
the algorithms in numerical simulations, such a practical use 
of the nonequilibrium relations has been proposed by several 
researchers ||5i|6l|7[]. We can implement our results in sush nu- 
merical methods and exploit them to investigate the equilibrium 
and nonequilibrium properties of spin glasses. In that sense, our 
study may serve as a basis for the application of the nonequi- 
librium relations to spin glasses in numerical simulations. 

Several nonequilibrium relations have been obtained by use 
of the gauge transformation for the dynamical system of spin 
glasses However we emphasize that our results are 

established by involving the property of the Jarzynski equality 
and the fluctuation therem, differently from these papers, such 
as the independence of the schedule of the process and the rela- 
tionship between two inverse processes. In that sense, we hope 
that our results would open a way to mitigate the difficulties to 
search the ground state for spin glasses. 

In this article, we showed the nonequilibrium relations only 
for the gauge-invariant quantities on NL. Other mysterious rela- 
tions for non gauge-invariant quantities are reported elsewhere 
ill. 
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